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Abstract. Recommender systems help people cope with the problem of information overload. A recently 
proposed adaptive news recommender model [Medo et al., 2009] is based on epidemic- like spreading of 
news in a social network. By means of agent-based simulations we study a "good get richer" feature of 
the model and determine which attributes are necessary for a user to play a leading role in the network. 
We further investigate the filtering efficiency of the model as well as its robustness against malicious and 
spamming behaviour. We show that incorporating user reputation in the recommendation process can 
substantially improve the outcome. 
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' 1 Introduction 

I We live in an information-rich world with a vast num- 
. ber of sources competing for our attention [21[3]. In ad- 
' dition to the old-fashioned information distribution sys- 
, tems, such as newspapers, which favor news of very gen- 

■ eral interest, recommender systems [31[51[3] act as person- 
I alized information filters by analyzing users' profiles and 
I past activities. Techniques used to produce recommenda- 
' tions include correlation-based collaborative filtering [SJ 
,13, Bayesian clustering 0, probabilistic latent semantic 

■ analysis |^, matrix decomposition |10j . and many others. 
[ However recent works show that similarity of past activi- 
. ties often plays a less important role than social influence 
' and recommendations obtained purely by abstract math- 
, ematical analysis are valued less than those coming from 
' our friends or peers [11) . A new approach, social recom- 
mendation, has hence emerged to make direct use of social 
connections between members of a society [12] • Examples 
of popular implementations of social recommender sys- 
tems include blogger.com and delicious.com, where each 
user can select some other users as information sources 
and imports blog articles or URLs from them. In these 
systems, information favored by an individual user spreads 
to the user's followers and, if favored again, to followers' 
followers, resembling an epidemics or rumor spreading in 
a network [HIH]. 

A recently proposed news recommender model mimics 
the spreading process typical for social systems and com- 



bines it with an adaptive network of connections 1 . In 
this model, when a user reads a news, she can either "ap- 
prove" or "disapprove" it. If approved, the news spreads 
to followers of the given user (whom we refer to as leader) . 
Each user has an evolving set of leaders (or, according to 
the terminology of the original paper, sources) and can be- 
come a leader for other users. Simultaneously with spread- 
ing of news, the leader-follower network evolves with time 
to best capture similarity of users. In [T] they provide a 
detailed description of an agent-based approach which is 
used to assess model's behaviour and test its performance. 

Every recommendation method, if it is to be imple- 
mented in real applications, has to respect the hetero- 
geneity of users. Users may differ, for example, by how 
often they use the recommender system, how broad are 
their interests, and how accurate they are in evaluation 
of recommended news. In this work we study the effects 
of introducing user heterogeneity in the above-described 
adaptive recommendation model. We show that when fre- 
quency of being active and evaluation noise vary among 
users, leaders with exceptionally high numbers of followers 
appear and a scale-free-like leadership structure emerges. 
Scale-free networks are observed in diverse systems [TS] 
and over the past two decades they attracted consider- 
able attention. The mechanism of their emergence based 
on user heterogeneity in a social recommendation process 
is similar to the previously discussed "good get richer" 
phenomenon [16] . 
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Heterogeneity also means that some users may try 
to intentionally misguide the system by providing wrong 
evaluations. We study whether the system is robust against 
such malicious behaviour, and if it can suppress low-quality 
content and promote high quality. While the original adap- 
tive recommender model already exhibits a notable re- 
sistance to malicious behaviour, we further improve it 
by introducing a simple measure of user reputation and 
employ a hybrid recommendation mechanism which com- 
bines similarities of users' rating patterns with reputation 
(for a review of reputation systems, see [17 ). We show that 
these changes enhance the filtering efficiency of the system 
and its robustness against various kinds of malicious be- 
haviour, leaving its performance almost unchanged. The 
proposed combination of reputation and personalized rec- 
ommendation hence seems as a promising candidate for 
real life applications. 



2 Description of the model 

We first briefly recall the original adaptive recommenda- 
tion model introduced in [T]. The system consists of U 
users. Each user is connected to L other users (to whom 
we refer as the user's leaders); in the network representa- 
tion this corresponds to a monopartite directed network 
with U nodes of fixed in-degree L. Evaluation of news 
(or a different kind of content) a by user i, 6^, is either 
-1-1 (liked), —1 (disliked) or (not rated yet). Similarity 
of reading tastes of users i and j, Sij, is estimated by 
comparing past users' assessments. If i and j evaluated 
Nij common news and agreed in Aij cases, their similar- 
ity can be measured in terms of the overall probability of 
agreement 

=^(l- (1) 

where the term in parentheses disadvantages user pairs 
with small overlap Nij (their similarity estimates, albeit 
possibly high, are prone to statistical fluctuations) . If Nij = 

then Sij is undefined and replaced by a small positive 
value So- Apart from their ratings, no other information 
about users is assumed by the model. 

Propagation of news is governed by their recommenda- 
tion scores. We denote as Ria the recommendation score 
of news a for user i. When news a is introduced to the 
system by user i at time ta, its initial recommendation 
score is Rja{ta) = Sij for users j who are followers of 

1 and it is zero for the others (i.e., it cannot be recom- 
mended to them yet). In this way, the news is passed from 
user i to i's followers. If this news is later liked by one of 
users j who received it, it is similarly passed further to this 
user's followers, and so on. A user may receive the same 
news from multiple leaders — recommendation scores are 
summed up in that case, reflecting that a news liked by 
several leaders is more likely to be liked by this user too. 
To allow fresh news to be accessed fast, recommendation 
scores are exponentially damped with time. In this way, 
novelty of news fades with an exponential law |18) . By 



combining the described processes, we have the formula 
for the recommendation score 

Rjait) = (1 - <5|e,„|,i)A*-*° 5e,.,i- (2) 

Here Lj is the set of leaders of user j and A G (0, 1] is the 
damping factor. The term (5e,Q,i is one when user / liked 
news a and zero otherwise. Similarly, the term 1 — <5|ej^|,i 
equals one only when user j has not rated news a yet. 
For user j at time t, news are recommended according to 
their current score Rja{t) (the higher, the better). Note 
that the described damping mechanism is different from 
the one proposed in [l; where the damping factor was ad- 
ditive and the damping occurred only if too many news 
were recommended to a user. Our motivation for decreas- 
ing scores always is that news lose their novelty regardless 
of being recommended or not, and that the multiplicative 
factor keeps Ria (t) positive, hence even old news can be in 
principle read by users if there are no relevant fresh news 
with higher recommendation scores. Since the spreading 
of a news over a long path may take long time, recom- 
mendation scores decreasing with time not only enhance 
novelty in the system but also promote news that come 
from the local neighborhood, effectively working as a local 
news filter. 

Starting from an initial random network configura- 
tion (random assignment of leaders to users), connections 
are periodically rewired to drive the system to an opti- 
mal state where users with high similarity (taste mates) 
are directly connected. In this way the topological evo- 
lution of the network and the dynamics of the network's 
nodes becomes invariably linked, as in other adaptive co- 
evolutionary networks [19^. Thus the updating procedure 
is an important part of the model. Some simple methods 
are: 

1. Global rewiring. Leaders are selected using all cur- 
rently available information: for each user i, L lead- 
ers with the highest similarity values Sij are selected. 
This is the best performing method but it is also com- 
putationally expensive as it requires computation of 
all U{U — 1)1 2 similarity values. 

2. Random rewiring. For each user, the leader with the 
lowest similarity value is replaced with a randomly cho- 
sen user (if this user is even less similar, no replacement 
occurs). This is the simplest possible method but its 
rate of convergence to the optimal state is, as we will 
see, very slow. 

3. Local rewiring. For each user z, the leader with the low- 
est similarity value is replaced with the most similar 
user among leaders of i's leaders (hence we are explor- 
ing z's neighborhood within the distance of two). This 
mechanism is based on the simple observation that two 
users who share a common neighbor are likely to be 
similar (for more sophisticated methods for link predic- 
tion in networks based on propagation of trust /similarity, 
see [2U1I25). Computational cost of this method scales 
as 0{UL'^) and hence as long as < J7 (a mild con- 
straint, since L is small), this method is faster than 
global rewiring. 
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4. Hybrid rewiring. Random rewiring is used in 10% of 
cases and local rewiring is used in the others. This 
rewiring mimics the natural evolution of communities 
where users search for friends among friends of friends 
(local rewiring) but also casual encounters occur and 
may lead to long-term relationships (random rewiring) . 

While the first three methods were already studied in p, , 
the last one is novel. 

For numerical tests of the model, we use the agent- 
based framework described in [T] . Taste of user i is repre- 
sented by a J5-dimensional binary vector and attributes 
of news a by a D-dimensional binary vector . Each vec- 
tor has a fixed number, Da, of elements equal one (active 
tastes) and all remaining elements equal zero. We always 
set the system so that all mutually different user taste 
vectors are present exactly once, hence U — (^)- This 
also means that taste vectors of two users differ at least 
in two elements. Opinion of user i about news a is based 
on the overlap of the user's taste vector with the news's 
attribute vector 

^ia — (tj; &a) (3) 

where (•, ■) is a scalar product of two vectors. If Qia > 
user i likes news a {eia = +1), otherwise she dislikes it 
i^ia = ~1)- The value Ai is an approval threshold of user 
i; the higher it is, the more demanding the user is. 

Simulation runs in discrete time steps. In each step, an 
individual user is active with probability pA- When active, 
the user reads and evaluates the top R news from her rec- 
ommendation list and with probability ps submits a new 
news with attributes identical to the user's tastes. To save 
computational time, the network of connections is rewired 
every ten time steps. Finally to measure the system's per- 
formance, we use approval fraction which is the ratio of 
approvals to all assessments and tells us how often users 
are satisfied with the news they get recommended, and 
average differences which is the average number of vector 
elements in which users differ from their leaders and tells 
us how well the network has adapted to users' tastes. 



2.1 Rewiring performance 

Since the aforementioned hybrid rewiring method is new, 
we begin this study with its comparison to the previously 
known methods. For simplicity we assume a homogeneous 
setting of users with identical values of Ai, pA, and ps- 
Figure [1] shows that all methods are able to gradually 
improve both approval fraction and average differences. 
Apart from local rewiring, the other three methods slowly 
approach the optimal assignment of leaders with average 
differences equal two. This ability to converge is due to 
a gradually increasing pool of commonly evaluated news 
which allows for precise similarity estimates and, eventu- 
ally, the optimal assignment of leaders. Since pA is small, 
the amount of available information grows slowly and em- 
ploying the rewiring more often would not make the con- 
vergence much faster. Note that as for each user there are 
N = Da{D — Da) possible optimal leaders who differ ex- 
actly in two taste elements, the optimal state is unique 
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Fig. 1. Comparison of rewiring mechanisms for D = 14, Da 
6, L = 10, i? = 3, PA = 0.05, PS = 0.02, zi = 3, A = 0.9. 



only a L = N. li L < N there are different possible opti- 
mal states which are equivalent in term of global proper- 
ties of the system. Initial conditions and users' dynamics 
determine the particular equilibrium state of the system. 
If L > iV (which is not our case, however), average dif- 
ferences are greater than two even in the optimal state. 

By contrast, local rewiring reaches only a sub-optimal 
assignment of leaders (the degree of sub-optimality strongly 
depends on the ratio between the number of optimal lead- 
ers to the total number of users, and also on the partic- 
ular realization of system's evolution). This is because if 
the network's evolution once stops in a sub-optimal state, 
there is no means to escape from it with local rewiring: 
if user's best taste mates are at that moment out of the 
second-order neighborhood, they can never be reached. In 
other words, the effectiveness of local rewiring is limited 
by the current network's topology, which completely de- 
termines the pool of candidate leaders for each user. Unlike 
other rewiring methods, such pool is very small compared 
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Fig. 2. Simulation steps needed by hybrid rewiring — with 
diflFerent percentage of randomness — to reach different values 
of the average differences in the system. Simulation parame- 
ters as in Figure [T] At the beginning of the evolution the local 
facet of the rewiring speeds up the convergence (see the line 
relative to average differences equal to 4.5). However, as sys- 
tem's approach equilibrium, the random facet becomes more 
suitable for network's exploration, as it allows to connect users 
regardless of their distance (see line relative to average differ- 
ences equal to 2.5). We employ a randomness of 10% to have 
both fast convergence at the beginning of the evolution and 
reasonable time to get to the ground state. 



to the whole network (< L"^ users) and it changes slowly 
in time. This trapping in a sub-optimal state is hence sim- 
ilar to the trapping of greedy optimization algorithms in 
a local minimum. 

Methods' convergence rates differ significantly, with 
global and random rewiring being the fastest and slow- 
est, respectively. Notably, the hybrid method converges 
almost as fast as the global one (the relation between sys- 
tem's convergence rate and the percentage of randomness 
used in the hybrid rewiring is shown in Figure [5]) . We con- 
clude that hybrid rewiring represents a favorable compro- 
mise between performanceand computational complexity, 
hence it is used in all following simulations. 



3 Heterogeneity and leadership 

In real social networks there are people with different pro- 
files. In this section we study the efi^ects of usage frequen- 
cies and judgment abilities on the leader- follower network. 
Activity frequencies pA are drawn from a power-law dis- 
tribution 



(4) 



In this way we obtain a very diverse set of activity fre- 
quencies which mimics the observed scale-free patterns of 
human behaviour [22| . Exponent 7 can be tuned to obtain 
a desired percentage of highly active users. In our simula- 
tions we set 77 = 0.01 and 7 = 2 which implies that 10% of 
users have pA > lOry. For the sake of simplicity we assume 
Ps = Pa/10 (that is, a user who is often online also has a 



high submitting rate). This assumption gets on well with 
real life experience: high usage users are also the ones who 
contribute most to the functioning of the system by intro- 
ducing hot news. The second source of user heterogeneity 
lies in diverse levels of errors present in their evaluations. 
We model this feature by generalizing equation ^ to 



f2ia — (ti,cla) 



(5) 



where u is a random value drawn at each assessment from 
the uniform distribution with domain [—1, 1] and Xi is the 
fixed magnitude of evaluation errors for user i, distributed 
uniformly in [0,X]. 

Figure [3] illustrates the impact of heterogeneity on the 
system. The upper panel shows the time evolution of the 
network. Compared to the original homogeneous case (which 
is shown with a dotted line), convergence to the opti- 
mal state is lost and the evolution itself is so slow that 
the system can be considered to stay in a quasi-steady 
and sub-optimal state. Moreover, as shown in the bot- 
tom panel, the out-degree distribution (recall that a user's 
out-degree is equal to the number of the user's follow- 
ers) becomes very broad. The initial part of the distri- 
bution can be fitted by a power law with exponent ap- 
proximately 1.5. A similar distribution arises also when 
global rewiring is used, though it is narrower than in the 
case of hybrid rewiring (the corresponding power-law ex- 
ponent rises to approximately 2.0). This suggests that the 
emergence of a scale-free leadership structure is related to 
self-organization in the society [2 3) and that a centralized 
control favors more homogeneous resulting states. 

System dynamics can be explained by the presence of 
users who have high usage frequencies and, in turn, also 
much more evaluations of news than the average. At the 
beginning of the evolution, a large overlap of users' rating 
histories favors the formation of links (this feature does 
not depend on the term in parentheses in ([T])), and high 
usage users are obviously in advantage: they quickly at- 
tract many followers and become hubs of the network. 
Then if two taste-mates are linked to different hubs, even 
as time runs further they rarely evaluate the same news 
and their high similarity remains undiscovered: connec- 
tions with high usage users are not abandoned and the 
network is trapped in a sub-optimal state and cannot 
evolve further. A high submitting rate for high usage users 
magnifies this phenomenon, as there are much more news 
which precisely reflect the tastes of these users (with a 
constant value of ps for each user, the convergence of the 
system is improved and the out-degree distribution gets 
slightly narrower). Evaluation noise plays an important 
role as well: precise users are preferred as leaders because 
they forward news that really match their tastes (and thus 
probably also followers' tastes). Besides, as these users 
give accurate ratings, they get a more stable and reliable 
similarity score with other users than the average, hence 
are easier to be identified as taste mates by other users. 
On the other hand, evaluations of a user with a very large 
error magnitude are basically random and hence the re- 
sulting similarity with any other user is close to 0.5 which 
makes this user unlikely to be selected as a leader. 
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Fig. 3. Average differences vs time (upper panel) and out- 
degree distribution (bottom panel) for heterogeneous settings 
with various values of maximal magnitude of evaluation noise 
X. For comparison, results for the original homogeneous set- 
ting (with X = 0, Pa equal to the average activity in the 
homogeneous setting and ps such to have the same average 
number of news in the system) is shown with the dotted line 
(upper panel) and stars (bottom panel). Parameter values as 
in Figure [T] Bottom panel also reveals the spontaneous emer- 
gence of two classes of users (with high and low out-degree 
respectively), a phenomenon typical of adaptive networks 124]. 



Figure |4] reports how both usage frequency and eval- 
uation noise affect user's out-degree. As explained above, 
highly active users and precise users have on average more 
followers than other users. Note that active but imprecise 
users, as well as precise but lazy ones, cannot be popu- 
lar leaders as opposed to the few who posses both fea- 
tures. These exceptional users attract a large number of 
followers, allowing for the scale- free leadership structure to 
emerge. This behavior is similar to the "good get richer" 
mechanism |16| which explains a scale-free network struc- 
ture on the basis of intrinsic fitness values of nodes. 
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Fig. 4. Out-degree versus activity frequency pa and individual 
evaluation error magnitude Xi {X — DaI^^, other parameters 
as in Figure [T]). 



4 Quality and reputation 

Until now it was only the overlap between user's tastes and 
news's attributes what distinguished a liked news from a 
disliked one. Now we shall amend the rating process by 
another important factor, intrinsic quality of news. To this 
end, we assign a real- valued quality to each submitted 
news and generalize equation (|3]) to the form 



(6) 



Quality of news is chosen when the news enters the sys- 
tem and does not change with timeQ We draw Qa from 
the normal distribution with mean 1 and standard devi- 
ation 1/2 (normal distribution is chosen to have only a 
small number of exceptionally good or bad news); when 
Qa lies out of the range [0;2], the draw is repeated. Fig- 
ure [5] shows how news of different qualities propagate over 
the network. Remarkably, the recommender system has a 
high filtering efficiency: high-quality news spread to many 
users while low-quality news perish quickly. Saturation of 
the number of readers for high-quality news is mainly due 
to the damping factor A. We remark that the spreading 
of a news in the system can be compared to a branching 
process [551 of the number of the news' readers. News' 
propagation stops only when there are no users who could 
read or like it. Such a cascade can either die out quickly 
(when the news is liked by few) or invade a finite fraction 
of the system (when it is liked by many). 

Once we have introduced the concept of news qual- 
ity to our simulations, it is straightforward to use it to 
investigate system vulnerability to malicious behaviour. 
We introduce two different kinds of malicious users to 
our system: (a) users with non-informative ratings (either 
rating at random, always liking, or always disliking), (b) 
spammers who intentionally introduce low-quality con- 
tent. Non- informative users are easily taken care of by 
the system because their similarity values with normal 



^ The quality factor in ((6} transforms the overlap from inte- 
ger to real value, resulting in a smoother dependence of system 
behaviour on approval threshold A. Introduction of Qa hence 
makes simulation results more robust and easier to analyze. 
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Fig. 5. The dependency between the number of readers and 
the news' quality. Simulation parameters: D = 14, Da = 4, 
L = 5, = 10, PA = 0.05, PS = 0.1, zi = 2, A = 0.9, X = 
Da/4:, hybrid rewiring of the network every 50 time steps. 



users are small and they are soon disconnected from the 
network. In particular, all-like and all-dislike users have 
high mutual similarity and hence they form small separate 
communities. Our adaptive system is thus robust against 
malicious users of this kind. 

With respect to spammers, the system is rather robust 
to their actions because a single low-quality news intro- 
duced by a spammer spreads only to a limited number of 
spammer's followers and as soon as they dislike the news, 
the news is removed from the system without affecting a 
large number of users. Alas, spammers can submit a large 
amount of worthless content and hence even a limited im- 
pact of each individual low-quality news can contribute 
to substantial discomfort of users. One could further ar- 
gue that when followers of spammers dislike their low- 
quality news, spammers' similarity values suffer and soon 
they are left with no followers. However, as we shall soon 
see, spammers can easily mask themselves by reasonably 
rating other news and hence keep their followers. At the 
same time, users submitting high-quality content are not 
rewarded with high popularity in the original model. 

Instead of studying spammers and providers of good 
content, we pose a more general question: if the quality 
of submitted news differs from one user to another, what 
is the relation between the quality of news posted by a 
user and this user's out-degree? To simulate users with 
different submitting abilities we simply assume that each 
user has assigned a quality Qi and a news takes its qual- 
ity from the user who submits it. In this way we obtain 
a system where some users always introduce low-quality 
content (spammers) and others who submit high-quality 
news (good sources). 

We introduce reputation as a tool to discriminate users. 
Reputation systems, already widely used in successful com- 
mercial online applications, represent an important class 
of decision support tools that can help reduce risk when 
engaging in interactions on the Internet and also encour- 



age good behaviour [T7] . Reputation itself is a measure of 
trustworthiness based on referrals or ratings from other 
members of a community 26,27 . In our case, we intro- 
duce the reputation score of user i as 




(7) 



where li is the set of news introduced by i and la is the 
fraction of all user^ who liked news a; when li = (no 
news submitted by this user), we set = 0. Using user 
similarity and reputation, we set the strength of the link 
coming from user j to user i as 



msij + (1 — m)rj 



(8) 



where m is a mixing parameter which sets the weight of 
similarity and reputation in the recommendation process 
(notice that s[j is not symmetric). This mechanism differs 
from the traditional popularity-based recommendation in 
replacing the object's popularity with that of the author as 
well as in using a spreading mechanism in a social adaptive 
network. When m = 1, we recover the original reputation- 
free model, when m = 0, recommendation is based purely 
on reputation, and submitters of news of general interest 
are favoured by achieving a high value of la ■ 

In simulations we draw users' quality values Qi from 
the same distribution that we used for news' quality val- 
ues Qa before. As shown in Figure IHl in the original set- 
ting (m — 1) user's number of followers does not depend 
on the user's quality — a feature that has been discussed 
above. When m is significantly less than 1, reputation of 
users plays an important role and users with low values of 
Qi can be left with no followers (when m < 0.7). More- 
over, as the introduction of the reputation system causes 
news' qualities to affect the recommendation scores, the 
relative size of cascades in news propagation is magnified. 
Therefore, the similarity-reputation hybrid mechanism in- 
creases the filtering capability of the system. When m — 0, 
leaders are selected and news are recommended purely ac- 
cording to reputation. As a result, recommended news are 
diverse and of high quality but not personalized for each 
individual user. Thus when the role of reputation is too 
big (m is too small) users' satisfaction decreases. This is 
reported in Figure [7] where, when m is small, approval 
fraction is lower than in the original model. At m « 0.7 
we observe a behaviour which is similar to a second order 
phase transition: approval fraction suddenly stops to grow 
and remains practically constant until m — 1. This sta- 
tionarity of approval fraction, while somewhat surprising, 
in fact makes our system easier to tune: all values of m 
between 0.7 and 1.0 are equally good (with respect to ap- 
proval fraction) and hence we can freely decide how much 
we want to suppress users providing low-quality content 
(c/. Figure [6]). 



It is also possible to define la using only the users who 
rated news a. Numerical simulations show that using the for- 
mer definition better distinguishes users with different Qi. 
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After the advent of Web 2.0, many on-line resource-sharing 
virebsites have been developed and their popularity grows 
steadily. Some of them (delicious.com, douban.com, and 
others) recently introduced social recommendation where 
users can recommend content to others and in turn re- 
ceive recommendations for themselves. Fast growth of on- 
line communities [35] and users' preference for recommen- 
dations from friends [11] make social recommendation a 
promising way to better organize and deliver online re- 
sources and to enhance users' experience as well as social 
contacts. 

The news recommender model introduced in 1^ and 
further analyzed and improved in this work mimics spread- 
ing processes in adaptive social networks. It makes use 
both of users submitting new content as well as of other 
users rating that content and deciding its future fate in 
the system. We studied the behaviour and performance 
of this model in artificial computer simulations. We pro- 
posed a new method for the network's adaptation. This 
method is almost as efficient as global optimization using 
all available information, yet it is computationally much 
less expensive. Investigation of user heterogeneity showed 
that users' personalities strongly influence the properties 
of the resulting leader- follower network and give rise to a 
"good get richer" mechanism which was suggested in pre- 
vious theoretical studies of complex networks [16]. Our 
simulations show that popularity of individual leaders is 
very broadly distributed; it can be partially described by 
a power law with exponent around 1.5. We further stud- 
ied model's resistivity against reckless and malicious be- 
haviour of users. Although the original model is already 
rather resistant to such users, we showed that when user 
reputation is introduced and recommendations are ob- 
tained by mixing this reputation with user similarity, power 
of malicious users can be further lowered and diffusion of 
good contents in the system enhanced. 

Agent-based models similar to the one studied here 
can contribute greatly to our understanding of social sys- 
tems 129 as they allow us to study the effect of each in- 
dividual model's assumption on the simulation outcome. 
The drawback is that the complexity of assumptions can 
be such that it is hard to make a link between the model 
and the modeled system. In addition to our efforts to 
make results robust with respect to the assumptions, it 
still would be beneficial to have direct empirical input for 
user behaviour. We envision a real implementation of the 
studied recommendation model as an ideal source of this 
kind of information, serving as a useful tool for users and 
a unique living laboratory for researchers. 
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Fig. 7. Stationary values of the approval fraction for different 
values of m. Simulation parameters as in Figure [S] 
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